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Abstract 

In this paper, we formulate an evolutionary multiple access channel 
game with continuous-variable actions and coupled rate constraints. We 
characterize Nash equilibria of the game and show that the pure Nash 
equilibria are Pareto optimal and also resilient to deviations by coalitions 
of any size, i.e., they are strong equilibria. We use the concepts of price 
of anarchy and strong price of anarchy to study the performance of the 
system. The paper also addresses how to select one specific equilibrium 
solution using the concepts of normalized equilibrium and evolutionary 
stable strategies. We examine the long-run behavior of these strategies 
under several classes of evolutionary game dynamics such as Brown-von 
Neumann-Nash dynamics, and replicator dynamicsQ^] 
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1 Introduction 



Recently, there has been much interest in understanding the behavior of multi- 
ple access channels under constraints. Considerable amount of work has been 
carried out on the problem of how users can obtain an acceptable throughput 
by choosing rates independently. Motivated by the interest in studying a large 
population of users playing the game over time, evolutionary game theory was 
found to be an appropriate framework for communication networks. It has been 
applied to problems such as power control in wireless networks and mobile inter- 
ference control pp. In jS], an additive white Gaussian noise (AWGN) multiple 
access channel problem was modeled as a noncooperative game with pairwise 
interactions, in which users were modeled as rational entities whose only inter- 
est was to maximize their own communication rates. The authors obtained the 
Nash equilibria of the two-user game and introduced a two-player evolutionary 
game model with pairwise interactions based on replicator dynamics. However, 
the case when interactions are not pairwise arises frequently in communication 
networks, such the Code Division Multiple Access (CDMA) or the Orthogonal 
Frequency-Division Multiple Access (OFDMA) in Worldwide Interoperability 
for Microwave Access (WiMAX) environment pp. 

In this work, we extend the study of [5] to wireless communication systems 
with an arbitrary number of users corresponding to each receiver. We formulate 
a static non-cooperative game with m users subject to rate capacity constraints 
and extend the constrained game to a dynamic evolutionary game with a large 
number of users whose strategies evolve over time. Different from evolutionary 
games with discrete and finite number of actions, our model is based on a class 
of continuous games, known as continuous-trait games. Evolutionary games 
with continuum action spaces can be seen in a wide variety of applications 
in evolutionary ecology, such as evolution of phenology, germination, nutrient 



foraging in plants, and predator-prey foraging [TOI I2U] . 

1.1 Contributions 

The main contributions of this work can be summarized as follows. We show 
that the static continuous kernel rate allocation game with coupled rate con- 
straints has a convex set of pure Nash equilibria, coinciding with the maximal 
face of the polyhedral capacity region. All the pure equilibria are Pareto optimal 
and are also strong equilibria, resilient to simultaneous deviation by coalition of 
any size. We show that the pure Nash equilibria in the rate allocation problem 
are 100% efficient in terms of Price of Anarchy (PoA) and constrained Strong 
Price of Anarchy (CSPoA). We study the stability of strong equilibria, nor- 
malized equilibria, and evolutionary stable strategies (ESS) using evolutionary 
game dynamics such as Brown- von Neumann-Nash dynamics, generalized Smith 
dynamics, and replicator dynamics. 

1.2 Organization of the paper 

The rest of the paper is structured as follows. We present in the next section the 
evolutionary game model of rate allocation in additive white Gaussian multiple 
access wireless networks, and analyze its equilibria and Pareto optimality. In 
Section [3j we present strong equilibria and price of anarchy of the game. In 
Section [4j we discuss how to select one specific equilibrium such as normalized 
equilibrium and evolutionary stable strategies. Section [5] studies the stability of 
equilibria and evolution of strategies using game dynamics. Section [7] concludes 
the paper. 



2 The Game Model 



We consider a communication system consisting of several receivers and several 
senders (See Figure [I]). At each time, there are many local interactions (typi- 
cally, at each receiver there is a local interaction) at the same time. Each local 
interaction will correspond to a non-cooperative one-shot game with common 
constraints. The opponents do not necessarily stay the same from a given time 
slot to another time slot. Users revise their rates in view of their payoffs and the 
coupled constraints (for example by using an evolutionary process, a learning 
process or a trial-and-error updating process). The game evolves in time. Users 
are interested in maximizing a fitness function based on their own communi- 
cation rates at each time, and they are aware of the fact that the other users 
have the same goal. The coupled power and rate constraints are also common 
knowledge. Users have to choose independently their own coding rates at the 
beginning of the communication, where the rates selected by a user may be 
either deterministic, or chosen from some distribution. If the rate profile ar- 
rived at as a result of these independent decisions lies in the capacity region, 
users will communicate at that operating point. Otherwise, either the receiver 
is unable to decode any signal and the observed rates are zero, or only one of 
the signals can be decoded. The latter case occurs when all the other users are 
transmitting at or below a safe rate. With these assumptions, we can define a 
constrained non-cooperative game. The set of allowed strategies for user j is 
the set of all probability distributions over [0, +00 [, and the payoff is a function 
of the rates. In addition, the rational action (rates) sets are restricted to lie in 
the capacity regions (the payoff is zero if the constraint is violated). In order 
to study the interactions between the selfish or partially cooperative users and 
their stationary rates in the long run, we propose to model the rate allocation 
in Gaussian multiple access channels as an evolutionary game with a continuous 



action space and coupled constraints. The development of evolutionary game 
theory is a major contribution of biology to competitive decision making and 
the evolution of cooperation. The key concepts of evolutionary game theory 
are (i) Evolutionary Stable Strategies 12], which is a refinement of equilibria, 
and (ii) Evolutionary Game Dynamics such as replicator dynamics 16], which 
describes the evolution of strategies or frequencies of use of strategies in time, 



Figure 1: A population: distributed receivers and senders, represented by blue 
rectangles and red circles respectively. 

The single population evolutionary rate allocation game is described as fol- 
lows: there is one population of senders (users) and several receivers. The 
number of senders is large. At each time, there are many one-shot games called 
local interactions. Each sender of the population chooses from the same set of 
strategies A which is a non-empty, convex and compact subset of R. Without 
loss of generality, we can suppose that user j chooses its rate in the interval 
A = [0, C{j}], where C^y is the rate upper bound for user j (to be made precise 
shortly) , as outside of the capacity region the payoff (as to be defined later) will 
be zero. Let A(_4) be the set of probability distributions over the pure strategy 
set A. The set A (A) can be interpreted as the set of mixed strategies. It is also 
interpreted as the set of distributions of strategies among the population. Let 



mm. 




Af 6 A(_4), and £ be a At— measurable subset of R m ; then Xt(E) represents 
the fraction of users choosing a strategy out of E, at time t. A distribution 
Aj € A (^4) is sometimes called the "state" of the population. We denote by 
M(A) the Borel a— algebra on A and by d(X, A') the distance between two states 
measured with the respect to the weak topology. Each user's payoff depends on 
opponents' behavior through the distribution of opponents' choices and of their 
strategies. The payoff of a user j in a local interaction with (m — 1) other users 
is given as a function v? : W n — > R. The rate profile a € R m must belong to 
a common capacity region C C M m defined by 2 m — 1 linear inequalities. The 
expected payoff of a sender transmitting with the rate a when the state of the 
population is ^ G A(_4) is given by F(a,fj,). The expected payoff is 



The population state is subjected to the "mixed extension" of capacity con- 
straints M{C). This will be discussed in Section[5]and will be made more precise 
later. 

2.1 Local Interactions 

A local interaction refers to the problem setting of one receiver and its uplink 
additive white Gaussian noise (AWGN) multiple access channel with several 
senders (say m > 2) with coupled constraints (or actions). The signal at the 
receiver is given by Y = £ + Ylj—i Xj where Xj is a transmitted signal of 
user j and £ is zero mean Gaussian noise with variance erg. Each user has an 
individual power constraint E(X?) < P. The optimal power allocation scheme 
is to transmit at the maximum power available, i.e. P, for each user. Hence, 
we consider the case in which maximum power is attained. The decisions of the 
users then consist of choosing their communication rates, and the receiver's role 




is to decode, if possible. The capacity region is a set of all vectors a € K™ such 
that users j = 1,2, ... , m can reliably communicate at rate a J , j = 1, . . . , m. 
The capacity region C for this channel is the set 



where SI := {1,2,..., m}. We refer the reader to pCT for more details on the 
capacity region. Notice that there is a tradeoff between high and low rates: if 
user j wants to communicate at a higher rate, one of the other users k may need 
to lower its rate, otherwise the capacity constraint is violated. 

Example 2.2. (Example of capacity region with three users) In this example, 
we illustrate the capacity region with three users. Let a 1 , a 2 , a 3 be the rates of 
the users. Based on My, we obtain 




(1) 



a 1 > 0,a 2 > 0,a 3 > 
a 1 < log(l + £) 



< 



a 2 < log(l + £) 
a 3 < log(l + £) 




a!+a 2 <log(l + 24) 
a 1 +a 3 < log(l + 24) 
a 2 + a 3 < log(l + 24) 




where in the compact notation, 
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Note that M3 is a totally unimodular matrix. By letting P = 25, = 0.1, we 
show in Figure [1] the capacity region with three users. 



We denote by 



log 1 



a* + (m - 1)P 



the rate of a user when the signal of the m — 1 other users is treated as noise, 
and C,j = log ( 1 + 1 J\-ji) its capacity. Note that r m = C{,„} — C{ m _i}. The set C 
is clearly a non-empty and bounded subset of K m . C is closed and is defined by 
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Figure 2: Capacity region with three users. 



2 m — 1 convex inequalities. Thus, C is convex and compact. From the inequality 



log ( 1 + 5> 3 - < log JJ(1 + Xj ) = £>g(l + x s ), 



for all Vx E E^ 1 , we obtain Cj < J2jeJ C {J}- 



2.3 Payoff 

We define the payoff of user j as 



u 3 (a 3 ,a 3 ) 



g(a J ) if (a 3 , a J ) € C 
otherwise 



where a J is the rate of the user j; the vector cT 3 := (a , . . . , o J_1 , a- 3 , . . . , a m ) 
is a profile of rates of the other users; the function g : R — > M is a positive and 
strictly increasing function. Given the strategy profile oT 3 of the others players, 



player j has to maximize u 3 (a 3 ,a 3 ) under its action constraints 



A(a-i) := {a 3 € [0,Cy } ], (a J ',aT J ') € C}. 

Using the monotonicity of the function g and the inequalities that define the 
capacity region, we obtain the following lemma. 

Lemma 2.3.1. Let BR(a~ J ) be the best reply to the strategy or 3 is 



BR(a 3 ) = arg max u 3 {y,a 3 ) 

yeA(a-i) 



BR is a non-empty single-valued correspondence (i.e., a standard function) 
which is given by 
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Cj - ^ a fc , J e Ti 



where Y := { J E 2 n , J 3 j}. 

Proposition 2.3.2. The set of Nash equilibria is 

{(a 3 , a' 3 ) | a* >r m ,^a 3 ' = C a }. 

j 

All these equilibria are optimal in the Pareto sensej^j 
Proof. Let /3 € C. If 

m p 

^/3 J < C n =log(l + m-a), 
i=i CT ° 

then at least one of the users can improve its rate (hence its payoff) to reach 

one of the faces of the capacity region. We now check the strategy profile in the 



3 An allocation of payoffs is Pareto optimal or Pareto efficient if there is no other feasible 
allocation that makes every user at least as well off and at least one user strictly better off 
under the capacity constraint. 



face 



If 



{(at, or*) | >r m ,^a J = C n }- 

4=1 



f3 G {{a\a~l) | cf > r m ,^V = C n }, 

4=i 

then from the Lemma, BR(f3~J) = {Z?- 7 }. Hence, j3 is a strict equilibrium. More- 
over, this strategy /3 is Pareto optimal because the rate of each user is maximized 
under the capacity constraint. These strategies are social welfare if the quantity 

m m 

is maximized. □ 

Note that the set of pure Nash equilibria is a convex subset of the capacity 
region. 



3 Robust equilibria and efficiency measures 

3.1 Constrained Strong Equilibria and Coalition Proof- 

ness 

An action profile in a local interaction between m senders is a constrained 
k— strong equilibrium if it is feasible and no coalition of size k can improve 
the rate transmissions of each of its members with respect to the capacity con- 
straints. An action is a constrained strong equilibrium [3] if it is a constrained 
k— strong equilibrium for any size k. A strong equilibrium is then a policy from 
which no coalition (of any size) can deviate and improve the transmission rate of 
every member of the coalition (group of the simultaneous moves) , while possibly 
lowering the transmission rate of users outside the coalition group. This notion 



of constrained strong equilibria |_j is very attractive because it is resilient against 
coalitions of users. Most of the games do not admit any strong equilibrium 
but in our case we will show that the multiple access channel game has several 
strong equilibria. 

Theorem 3.1.1. Any rate profile on the maximal face of the capacity region 
C : 

m 

Face max (C) := {(«*',<*-') £ W m | oP > r ro ,^V = C n }, 
is a constrained strong equilibrium. 

Proof. We remark that if the rate profile a is not on the maximal face of the 
capacity region, then a is not resilient to deviation by a single user. Hence, a 
cannot be a constrained strong equilibrium. This says that a necessary condition 
for a rate profile to be a strong equilibrium is to be in the subset Face max (C). We 
now prove that the condition: a G Face max (C) is sufficient. Let a S F 'ace max (C) . 
Suppose that k users deviate simultaneously from the rate profile a. Denote by 
Dev the set of users which deviate simultaneously (eventually by forming a 
coalition) . The rate constraints of the deviants are 

1. a' 3 > 0, Vj G Dev, 

2- V. ; o"' • Cj. VJCDev, 

3- J2 je JnDev < Cj - T^eWe, ^ VJ C SI, J n Dev ± 0. 

In particular, for J = SI, we have J2j<=Dev a ' J — — YljdDev a 3 ■ ^ ne total rate 
of the deviants is bounded by Co — X^Deu a "'' which is not controlled by the 

4 Note that the set of constrained strong equilibria is a subset of Nash equilibria (by taking 
coalitions of size one) and any constrained strong equilibrium is Pareto optimal (by taking 
coalition of full size). 



deviants. The deviants move to (a' 3 )j e Dev with 

j£Dev j^Dev 

Then, there exists j such that a 3 > a' 3 . Since g is non-decreasing, this implies 
that g(aP) > g(a' 3 ). The user j who is a member of the coalition Dev does not 
improve its payoff. If the rates of some of the deviants are increased, then the 
rates of some other users from coalition must decrease. If (a' 3 )j e Dev satisfies 

E a>i = c * E a ° > 

j£Dev j^Dev 

then some users in the coalition Dev have increased their rates compared with 
(a J )j e Dev an d some others in Dev have decreased their rates of transmission 
(because the total rate is the constant Cq — J2j$Dev °- 3 )- The users in Dev with 
a lower rate a.' 3 < a? do not benefit to be member of the coalition (Shapley 
criterion of membership of coalition docs not hold) . And this holds for any 
C Z) ev CZ This completes the proof. □ 

Corollary 3.1.2. In the constrained rate allocation game, Nash equilibria and 
strong equilibria in pure strategies coincide. 

3.2 Constrained Potential Function for Local Interaction 

Introduce the following function: 

V(a) =\ c 



where ]c is the indicator function of C, i.e., ]c ( a ) = 1 if a G C and otherwise. 
The function V satisfies 



V(a) - V(P j ,a- j ) = g{a j ) - g{[3 r ), Va, GS-a -3 ') G C. 
If g is differentiable, then one has 



in the interior of the capacity region C, and V is a constrained potential function 
[22] in pure strategies. 

Corollary 3.2.1. TTie local maximizers of V in C are pure Nash equilibria. 
Global maximizers of V in C are both constrained strong equilibria and social 
optima for the local interaction. 

3.3 Strong Price of Anarchy 

Throughout this subsection, we assume that the function g is the identity func- 
tion, i.e., g(x) = id(x) :— x. One of the approaches used to measure how much 
the performance of decentralized systems is affected by the selfish behavior of 
its components is the price of anarchy. We present a similar price for strong 
equilibria under the coupled rate constraints. This notion of Price of Anar- 
chy can be seen as an efficiency metric that measures the price of selfishness 
or decentralization and has been extensively used in the context of congestion 
games or routing games where typically users have to minimize a cost function. 
In the context of rate allocation in the multiple access channel, we define an 
equivalent measure of price of anarchy for rate maximization problems. One of 
the advantages of a strong equilibrium is that it has the potential to reduce the 
distance between the optimal solution and the solution obtained as an outcome 



of selfish behavior, typically in the case where the capacity constraint is violated 
at each time. Since the constrained rate allocation game has strong equilibria, 
we can define the strong price of anarchy, introduced in [2; , as the ratio between 
the payoff of the worst constrained strong equilibrium and the social optimum 
value which Cq. 

Theorem 3.3.1. The strong price of anarchy of the constrained rate allocation 
game is 1 for g(x) = x. 

Note that for g ^ id, the CSPoA can be less than one. However, the op- 
timistic price of anarchy of the best constrained equilibrium also called price of 
stability [3] is one for any function g i.e the efficiency of "best" equilibria is 



4 Selection of Pure Equilibria 

We have shown in previous sections that our rate allocation game has a contin- 
uum of pure Nash equilibria and strong equilibria. We address now the problem 
of selecting one equilibrium which has certain desirable properties: the normal- 
ized pure Nash equilibrium, introduced in [T3] . See also [T51 13 IS] • We introduce 
the Lagrangian that corresponds to the constrained maximization problem faced 
by every user when the other rates are at the maximal face of the polytope C: 



100%. 



max 



u J (a) 



(2) 



a 



s.t. a 1 + ... + a m = 



(3) 



and the Lagrangian for user j is given by 




From Karush-Kuhn- Tucker optimality conditions, it follows that there exists 
C G W n such that 

rn 

g'(a j ) = ( j , £V = C n . 

3 = 1 

For a fixed vector £ with identical entries, define the normal form game r(£) 
with m users, where actions are taken as rates and the payoffs given by L(a, £). 
A normalized equilibrium is an equilibrium of the game r(£*) where £* is nor- 
malized into the form (* 3 = -y, c > 0, t 3 > 0. We now have the following result 
due to Goodman [5] which implies Rosen's condition on uniqueness for strict 
concave games. 

Theorem 4.0.2. Let u 3 be a smooth and strictly concave function in a 3 , each 
u 3 be convex in a~ 3 , and there exist some £ such that the weighted non-negative 
sum of the payoffs Y^jLi ( 3 u 3 {a) is concave in a. Then the matrix 

G(a,() + G T (aX) 

is negative definite (which implies uniqueness) where G(a, £) is the Jacobian 
with respect to a of 

h(a,Q ■= [C 1 V lW 1 (a),C 2 V 2U 2 (a),...,C m V mW m (a)] T 

and G T is the transpose of the matrix G. 

This now leads to the following corollary for our problem. 

Corollary 4.0.3. If g is a non- decreasing strictly concave function, then the 
rate allocation game has a unique normalized equilibrium which corresponds to 
an equilibrium of the normal form game with payoff L (a, £*) for some £*. 



5 Stability and Dynamics 



In this section, we study the stability of equilibria and several classes of evo- 
lutionary game dynamics. We show that the evolutionary game has a unique 
pure constrained evolutionary stable strategy. 

Proposition 5.1. The collection of rates 

(C a Ca\ 

a = , . . . , , 

\ m m J 

i. e the distribution of Dirac concentrated on the rate ^ , is the unique symmetric 
pure Nash equilibrium. 

Proof. Since the constrained rate allocation game is symmetric, there exists 
a symmetric (pure or mixed) Nash equilibrium. If such an equilibrium exists 
in pure strategies, each user transmits with the same rate r*. It follows from 
Proposition 



2.3.2 



and the bound r m < ^ that r* satisfies mr* = Co and r* 



is feasible. □ 

Since the set of feasible actions is convex, we can define convex combination 
of rates in the set of the feasible rates. For example, ea' + (1 — e)a is a feasible 
rate if a' and a are feasible. The symmetric rate profile (r, r, . . . , r) is feasible 
if and only if < r < r* = @9-. We say that the rate r is a constrained 
evolutionary stable strategy (ESS) if it is feasible and for every mutant strategy 
mut ^ a there exists e m ut > such that 

r c := e mut + (1 - e)r € C Ve G (0, e mut ) 
u(r, r e , . . . , r e ) > u(mut, r e ,...,r e ) Ve G (0, e mut ) 

Theorem 5.1.1. The pure strategy r* — — is a constrained evolutionary stable 
strategy. 



Proof. Let mut < r* The rate e mut+(l — e)r* is feasible implies that mut < r* 
(because r* is the maximum symmetric rate achievable). Since mut ^ r* , mut 
is strictly lower than r*. By monotonicity of the function g, one has 

u(r* , e mut + (1 — e)r*) > u(mut, e mut + (1 — e)r*), Ve. 

This completes the proof. □ 

5.2 Symmetric Mixed Strategies 

Define the mixed capacity region M. (C) as the set of measures profile (u 1 ,^ 2 , . . . , fi m ) 
such that 

J < 1 \jeJ J jeJ 

Then the payoff of the action a e R + satisfying (a, A, . . . , A) G A4(C) can be 
defined as 

F(a 1 u)= I u(a,b 2 ,...,b m ) f m -i(<#>), 

./[O.ool™- 1 

where ffc = 0* is the product measure on [0, oo[ fc . The constraint set becomes 
the set of probability measures on 1Z+ such that 

< E(a) := J oP ^{d^) < ^ < C {1} . 

Lemma 5.2.1. F(a,fi) =1 [ ,c n -(m-i)E( M )] xg(a)x 

/ V m _i(db) =1[ ,Cn-(m-l)E( M )] x 5 (a)z^ m _ 1 (D a ) 



w/iere 

£>a = {(&2, • ■ • , b m ) | (a, 6 2 , • • • , &m) € C} . 



Proof. If the rate does not satisfy the capacity constraints, then the payoff is 0. 
Hence the rational rate for user j is lower than C^j. Fix a rate a e [0, C{j}]- 
Let Dj := Cj — aS^ leJ j. Then, a necessary condition to have a non-zero payoff 
is 

(f>2, • ■ • ,b m ) e v a , 

where 

P a = {(6 2 ,...,6 ro )elR™- 1 , ^ 6j < D", J C 2 n }. 

Thus, 

F(o,/i) = / u(a,b 2 ,...,b m ) Vm-tidb) 
= / g(a) u m -i(db) 

JbGE™ \ (a,6)£C 
= 1[0,Cs2-(m-l)E( M )] 




^ m _i(rf6) 



□ 



5.3 Constrained Evolutionary Game Dynamics 

The class of evolutionary games in large population provides a simple frame- 
work for describing strategic interactions among large numbers of users. In this 
subsection we turn to modeling the behavior of the users who play them. Tra- 
ditionally, predictions of behavior in game theory are based on some notion of 
equilibrium, typically Cournot equilibrium, Bertrand equilibrium, Nash equi- 
librium, Stackelbcrg solution, Wardrop equilibrium or some refinement thereof. 
These notions require the assumption of equilibrium knowledge, which posits 
that each user correctly anticipates how his opponents will act. The equilibrium 
knowledge assumption is too strong and is difficult to justify in particular in con- 



texts with large numbers of users. As an alternative to the equilibrium approach, 
we propose an explicitly dynamic updating choice, a procedure in which users 
myopically update their behavior in response to their current strategic environ- 
ment. This dynamic procedure does not assume the automatic coordination of 
users' actions and beliefs, and it can derive many specifications of users' choice 
procedures. These procedures are specified formally by defining a revision of 
rates called revision protocol |14j . A revision protocol takes current payoffs and 
current mean rate and maps to conditional switch rates which describe how fre- 
quently users in some class playing rate a who are considering switching rates 
switch to strategy a'. Revision protocols are flexible enough to incorporate a 
wide variety of paradigms, including ones based on imitation, adaptation, learn- 
ing, optimization, etc. 

We use a class of continuous evolutionary dynamics. We refer to [TTirn?l[TB] 
for evolutionary game dynamics with or without time delays. The continuous- 
time evolutionary game dynamics on the measure space (A,B(A),[x) is given 



and ft* represents the rate of mutation from x to a, and if is a growth parameter. 
Pa(^t) = if (x, At) or (a, At) is not in the (mixed) capacity region, £ is a 
yU— measurable subset of A. At each time t, probability measure At satisfies 



by 




(4) 



where 




(it 



Xt(A) = 0. 



Constrained Brown-von Neumann-Nash dynamics. 



The constrained revision protocol is 



wo = 4 



max(F(a, A t ) - f x F(x, A t ) dx, 0) 
if (a, At), {x,X t )eM(C) 
otherwise 



Constrained Replicator Dynamics. 



max(F(a,A t ) - F(x,X t ),0) 
if (a, A t ), (x,A t ) 6A4(C) 
otherwise 



Constrained 6* Smith Dynamics. 



/») = 



max( J F(a,A t )-i ;l (x,A t ),0) 6 
if (a, At), (x,X t )eM(C) 
otherwise 



> 1 



We now provide a common property that applies to all these dynamics: the 
set of Nash equilibria is a subset of rest points (stationary points) of the evolu- 
tionary game dynamics. Here we extend to evolutionary game with a continuous 
action space and coupled constraints, and more than two-users interactions. The 
counterparts of these results in discrete action space can be found in [T3] . 

Theorem 5.3.1. Any Nash equilibrium of the game is a rest point of the fol- 
lowing evolutionary game dynamics: constrained Brown-von Neumann-Nash, 
generalized Smith dynamics, and replicator dynamics. In particular, the evo- 
lutionary stable strategies set is a subset of the rest points of these constrained 
evolutionary game dynamics. 

Proof. It is clear for pure equilibria by using the revision protocols /3 of these 



dynamics. Let A be an equilibrium. For any rate a in the support of A, /3° = 
if F(x,X) < F(a, A). Thus, if A is an equilibrium the difference between the 
microscopic inflow and outflow is V(a, A) = 0, given that a is the support of the 
measure A. □ 

Let A be a finite Borel measure on [0, Csj\] with full support. Suppose g is 
continuous on [0, C{j}]. Then, A is a rest point of the BNN dynamics if and only 
if A is a symmetric Nash equilibrium. Note that the choice of topology is an 
important issue when defining dynamics convergence and stability. The most 
used in this area is the topology of the weak convergence to measure closeness 
of two states of the system. Different distances (Prohorov metric, metric on 
bounded and Lipschitz continuous functions on A) have been proposed. We refer 
the reader to and the references therein for more details on evolutionary 
robust strategy and stability notions. 



6 Generalization 

In this section, we consider the asymmetric case. Each user has its maximum 
power Pi and a channel gain hi. In addition, the rate of transmission is subject 
to a coupled capacity constraint. The capacity region C is described by the set 



,5^0!* < C n , V c n c AT I 



| a e K"\)_a ! : C u . V c V. c A' } . (. r ,) 
where fi is any subset of N and 

/ „ Ph \ 

(6) 



co=iog(i + £^v 



is the capacity for users in f2. The capacity region reveals a competitive na- 
ture of the interactions among senders: if a user i wants to communicate at a 



higher rate, one of the other users has to lower his rate; otherwise, the capacity 
constraint is violated. We let 

i (, i \ 

r it n ■= log 1+ 2 „ ^-r- 

denote the bound rate of a user when the signals of the — 1 other users are 
treated as noise. 

Due to the noncooperative nature of the rate allocation, we can formulate 
the one-shot game 

S = (TV, (A l ) ie ^, {u l ) ieM ) , 

where the set of users Af is the set of players, A 1 , i G Af, is the set of actions, and 
u l , i G AT, are the payoff functions. We define u l : A 1 — >• M+ as follows. 

uV.O = ] c (a)g i (a i ,a- i ) (7) 

gHa 1 ) if (aSa-*) G C 
= < , (8) 

otherwise 

where ]q is the indicator function; a~ l is a vector consisting of other players' 
rates, i.e., oT % — [a 1 , . . . , a* -1 , a l+1 , . . . , a N ] and is a positive and strictly 
increasing function for each fixed a~ l . Since the game is subject to coupled 
constraints, the action set A 1 is coupled and dependent on other players' actions. 
Given the strategy profile a~ % of other players, the constrained action set A 1 is 
given by 

A'ia-*) := W G [0, C {i} ], {a\ O G C} (9) 

We then have an asymmetric game. The minimum rate that the user i can 
guarantee in the feasible regions is which is different than rjjj. 

Each user i maximizes w 4 (a J , a~ l ) over the coupled constraint set. Owing to 



the monotonicity of the function g % and the inequalities that define the capacity 
region, we obtain the following lemma. 

Lemma 6.0.2. Let BR l (a~ l ) be the best reply to the strategy oT 1 , defined by 



BR (a ') = arg max u l (y,a *). 

ye-4*(a-*) 



BR is a non-empty single-valued correspondence (i.e a standard function) , and 
is given by 

max r^, mm <.C n ^ a k \ , (10) 
V £ { ken\{i} J / 

where T t = {O G 2^,1 e ft}. 
Proposition 6.1. The set of Nash equilibria is 

{{a 1 , a~ 4 ) | a 1 > r iM , ^ a* = CV}. 

AZZ t/iese equilibria are optimal in Pareto sense. 
Proof. Let /3 be a feasible solution, i.e., /? e C. If 

l>h,\ 



2 / ' 

then at least one of the users can improve its rate (hence its payoff) to reach 
one of the faces of the capacity region. We now check the strategy profile on 
the face 

I (a*, a"*) 



If 

/3e I (a*, a"*) 



t=i J 
i=i J 



then from the Lemma |6.0.2| BR (/3~ l ) = {/?*}. Hence, j3 is a strict equilibrium. 
Moreover, this strategy (3 is Pareto optimal because the rate of each user is 
maximized under the capacity constraint. These strategies are social welfare 
optimal if the total utility 

N N 



is maximized subject to constraints. □ 

Note that the set of pure Nash equilibria is a convex subset of the capacity 
region. The pure equilibria are global optimg^] if the function g is the identity 
function. 



7 Concluding remarks 

In this paper, we have studied an evolutionary Multiple Access Channel game 
with a continuum action space and coupled rate constraints. We showed that the 
game has a continuum of strong equilibria which are 100% efficient in the rate 
optimization problem. We proposed the constrained Brown- von Neumann-Nash 
dynamics, Smith dynamics, and the replicator dynamics to study the stability 
of equilibria in the long run. An interesting question which we leave for future 
work is whether similar equilibria structure exist in the case of multiple access 
games with non-convex capacity regions. Another extension would be to the 
hybrid model in which users can select among several receivers and control the 
total rate, which is currently under study. 
5 This implies that the price of anarchy is one. 
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